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ABSTRACT 



This thesis is an independent partial evaluation of the 
Safety Reliability and Maintainability Program (SR&M). The 
two Measures of effectiveness which were used to see if the 
goals of this program were realized in the areas of 
maintainability and reliability are the Maintenance Manhours 
per Flight Hour and the Mean Flight Hours Between failures. 
Standard statistical analysis was performed utilizing the 
software packages GRAFSTAT and MINITAB. 
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I. INTRODUCTION 



The purpose of this thesis is to conduct an evaluation 

of the C-46 SR&M (Safety Reliability and Maintainability 
Program) . 

In December 1980, Boeing-Ver tol was awarded the initial 
contract for the helicopter improvement program known as 
SR&M. This program is intended to extend the effective 
service life of the HH-46 , CH-46D and CH-46E helicopters 
until the end of this century at a significantly reduced 
operating cost. 

There are three major goals for the SR&M program; 

- IMPROVED SATETY - reduce the number of personnel 
injuries and deaths that result from the malfunction 
of aircraft systems and its components. 

IMPROVED RELIABILITY - increase the mean flight hours 
between failures of aircraft components. 

- IMPROVED MAINTAINABILITY - reduce the maintenance man 
hours per flight hour. 

The first prototype SR&M modified CH-46E was flown in 
November, 1983. The first delivery to the Fleet Marine 
Force occurred in December, 1985. Marine Helicopter 
Training Squadron 204 (HMT-204) was the first Fleet Marine 
Force squadron to receive the modified aircraft. 

Today there are over fifty modified aricraft in service. 
Data on number of failures, flight hours and maintenance of 
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these aircraft has been accumulated in the Navy^s 
Maintenance Material Management System (3M). This data 
was used to conduct an evaluation of the SR&M program. The 
hoped for improvements in maintainability and reliability 
will be evaluated using the data accumulated on HMT-204's 
maintenance department . 

This squadron was selected because it has been operating 
this aircraft the longest. It also appears to be a good 
candidate since it has consistent and regular flight hour 
requirements each month. Unlike deploying fleet squadrons 
that gear-up for major operation and experience changing 
environments; operating from Navy ships which results in a 
higher supply priority code, HMT-204 does not deploy. 

A brief history of the CH-46 aircraft follows to emphasize 
how past modifications were made to improve or enhance the 
operational characteristics of the aircraft (i.e., airspeed, 
payload, range and all weather capabilities, etc.). The 
stated purpose of the SR&M modification is to improve the 
overall safety and reliability of the aircraft and its 
components. This should result in reduction of the 
maintenance cost associated with operating the CH-46E in 
the Fleet Marine Force. 

The SR&M (Service Reliability and Maintainability Program) 
modified CH-46E Tandem-rotor helicoptor in use by the United 
States Marine Corps has come a long way in its 30 year history. 
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Boeing-Vertol began preliminary design and engineering of 
the helicopter in 1956. Construction of the first prototype 
began in May, 1957. The first flight of the aircraft took 
place on April 22, 1958. The United States Marine Corps 

first ordered the CH-46A in February of 1961. The CH-46A 
was powered by 2 General Electric T58-GE-8 1250 shp (shaft 
horse power) engines. This aircraft had a maximum take-off 
and landing weight of 21,400 pounds and could cover a 230 
nautical mile range. This aircraft had little or no single 
engine capability. You could not maintain level flight with 
a single engine. The Marine Corps would eventually receive 
over 130 of this aircraft model. 

All CH-46s delivered after July, 1966 are designated 
CH-46D. The CH-46D is essentially similar to the CH-46A 
except the aircraft was now powered by 2 General Electric 
T58-GE-10 1400 shp engines. This aircraft had a maximum 
take-off and landing weight of 23,000 pounds (1,600 pound 
increase) and could cover a 238 nautical mile range. This 
aircraft had a limited single engine capability. Aircraft 
could operate at a minimal rate of descent depending on 
aircraft load and outside ambient conditions, if one of the 
engines stopped operating. Another major change in the D 
model production was the addition of cambered rotor blades 
to improve the aerodynamic performance of the rotor system. 
By June, 1969 the Marine Corps had received its' 500th 
CH-46 aircraft. 



9 



All CH-46s delivered after July, 1968 are designated 
CH-46F. The same engines and rotor blades used in the D 
model were used during F model production. The addition of 
improved navigational and electronic equipment was the 
reason for model designator modification. The maximum 
take-off weight did not change. With the addition of 275 
pounds of electrical equipment, the available payload was 
decreased accordingly. All D model CH-46s in the inventory 
also received the new equipment. This resulted in major 
differences in the electrical schematics and different 
operating procedures for each model in the event of certain 
electrical malfunctions. The production of CH-46Fs 
continued until 1971 when the last new CH-46 rolled off the 
assembly line. All future improvements and modifications 
would be made at the Naval Air Rework 'Facility (NARF) 

Cherry Point, North Carolina, 

Boeing-Vert ol modified 2 CH-46s in 1975 with 2 General 
Electric T58-GE-16 1870 shp engines. This model also 
included; crash attenuating seats for the pilots, a new 
crash and combat resistant fuel system, an improved rescue 
system and an updated navigational system. The Marine Corps 
accepted this program and agreed to modify 276 CH-46D/F to 
CH-46E configured aircraft. During August, 1977 the first 
CH-46E for the Fleet Mamie Force rolled out of the Naval 
Air Rework Facility (NARF) Cherry Point, North Carolina. The 
aircraft now had a maximum take-off and landing weight of 
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23.300 for internal cargo and could operate at a weight of 

24.300 with an external load. Internal loads are limited 
to 23,300 pounds due to the load bearing limits of the main 
landing gear.' The maximum range remained at 238 nautical 
miles. This aircraft has outstanding single engine 
characteristics; i.e.. It can hover in ground effect at 
its maximum take-off weight under all but extreme ambient 
conditions. During this conversion the Navy and Marine 
Corps sponsored substantial testing that resulted in the 
acquisition and use of Fiberglass rotor blades. By 1980 
there were 70 CH-46E configured with Fiberglass rotor 
blades. As a point of interest, with the significant 
reduction in maintenance required due to the Fiberglass rotor 
blades, the Second Marine Aircraf t Wing (2nd MAW) played 
musical chairs with the Fiberglass rotor systems, ensuring 
that all squadrons deploying out of th continental United 
States left with the new rotor system installed on their 
helicopters. It took unitl 1984 to equip all the CH-46s 

in the Marine Corps inventory with the new and improved 
Fiberglass rotor system. 

In December, 1980 Boeing-Ver tol was awarded the initial 
contract for the helicopter improvement program known as 
Service Reliability and Maintainability (SR&M). 
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II. DATA 



A. DATA COLLECTION 

Discussions were held with personnel at the Navy Sea 

Logistic Center Navy Maintenance Support Office, 

Mechanicsbur g , Pennsylvania to determine the availability 

of data needed to perform the evaluation analysis. It was 

decided that the Navy^s Aviation Maintenance Material 

Management System (3M) had the best data available. The 

Navy's 3M data has wide and varied purposes. 

DOCUMENTATION - The 3M program provides records which 
document that scheduled and unscheduled maintenance 
is performed in accordance with set and established 
procedures . 

MANPOWER ALLOCATION - Squadron manning levels are 
determined by the number of aircraft and mission 
requirements. The squadron must document that they 
are working technicians the prescribed hours per day. 

SAFETY - All Collateral Duty and Quality Assurance 
Inspectors signatures appear on the VIDS/MAF (Visual 
Information Display System/Maintenance Action Form) 
to attest to the fact they have inspected the work 
and witnessed the required procedures called for in the 
Maintenance Manuals . 

INFORMATION - Copies of all VIDS/MAFs generated during 
the last ten flights and all "up” gripes are maintained 
in the Aircraft Discrepancy Book (ADB) for the crew to 
review before accepting the aircraft for flight 
operations . 

- SPECIAL REPORTS - NAMSO 4790 . A7298-01 is one type of 
special report available from the 3M system. Table I 
shows a typical selection of the data used. 
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SAMPLE FROM NAMSO 4790.A7298 
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The 3M data is not collected to be used for strict 



statistical analysis. This data does not include the actual 
flight hours between failures. Consequently some analysis 
that could provide specific statistical inferences could 
not be made. However, some interesting comparative results 
were obtained using total flight hours, total failures and 
total maintenance man-hours, Mean Flight Hours Between 
Failures (MFHBF) and Maintenance Man-Hours per Flight 
Hour (MMH/FH). 

Observations made about the data base: 

- Although the data was not collected under experimental 
conditions and has some shortcomings, it appears from 
examination of the data that both data samples have 
the same inherent set of shortcomings relative to their 



A* general comparative analysis can be made with good 
credibility that assesses whether or not a significant 
decrease in MMH/FH was achieved. 

Some inferences can be made on the failure rates of key 
components as a function of the number of repairs 
previously made on the component. 

Every Maintenance Action Form (MAF) completed by HMT-204, 
to document maintenance performed by squadron personnel on 
aircraft, is forwarded to the Navy^s 3M system. This data 
was then tabulated by aircraft bureau number (serial number) 
to include the total number of maintenance actions performed, 
actual system/component failure, flight hours per aircraft 
and hours of maintenance performed (Table I). 



impact on 




analysis 
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A VIDS/MAF is generated in three ways: 

- MAINTENANCE CONTROL PERSONNEL will issue MAF's to 
document and ensure preventive maintenance is completed 
according to flight time and calendar requirements. 

- CREW CHIEFS or PLANE CAPTAINS will document aircraft 
discrepancies discovered during pre-flight and post 
flight inspections. 

- PILOTS and CO-PILOTS will document aircraft discrepancies 
discovered during pre-flight and post flight inspections. 
It is the pilot's responsibility to complete MAFs covering 
all malfunctioning aircraft systems and inform 
Maintenance Control of his feelings about the aircraft's 
operational status at the completion of all flights. 

Modifications to aircraft under the SR&M program were 

incorporated during the aircraft's scheduled Special Depot 

Level Maintenance (SDLM) cycle. Aircraft at Marine Corps 

Air Station (Helicopter), New River, with SDLM dates in 

1985 were transferred to HMT-204 . This accounts for the 

fact that HMT-204 was assigned 19 different aircraft during 

the time pre-SR&M data was collected. The 11 in the post 

SR&M sample include 1 that was sent back to NARF Cherry 

Point requiring extensive repair . HMT-204 is usually 

allocated 10 CH-46 aircraft. 

At the time the data was requested from Mechanicsburg , 

the last month entered in the Navy's Aviation 3M System was 

March 1987, HMT-204 received its last SR&M modified aircraft 

during April 1986. This means May 1986 was the first month 

the squadron's 3M data could be retrieved by Unit 

Identification Code (UIC). Consequently, 11 months was the 

longest period of time post SR&M data was available for an 
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operational fleet squadron. HMT-204 received its first 
SR&M modified aircraft during December 1985. In order to 
keep as much similarity as possible between the two data 
samples it was requested that the 11 months prior to first 
SR&M delivery be used for the pre-SR&M data base. The 
periods for the 2 data samples are as follows: January 1, 

1985 - November 30, 1985 for pre-SR&M (non-modif ied ) aircraft 
and May 1, 1986 - March 31, 1987 for post SR&M (modified) 
aircraft . 

The pre-SR&M sample contains 19 aircraft logging 2688 
flight hours. The post SR&M sample contains 11 aircraft 
logging 2322 flight hours during their respective periods. 

B. DESCRIPTION OF DATA 

Following is a description of th data (Table I) requested 
from the Navy's Maintenance Support Office in Mechanicsburg , 
Pennsylvania . 

- TOTAL FLIGHT HOUR - Flight hours reported by aircraft 
bureau number for sample period. 

- TOTAL MAINTENANCE ACTIONS - The number of unscheduled 
maintenance actions reported in VIDS /MAF‘ records . 

- MEAN FLIGHT HOURS BETWEEN MAINTENANCE ACTIONS - (MFHBMA) 
The total flight hours divided by the number of 
maintenance actions initiated. 

- TOTAL FAILURES - The number of maintenance actions that 
were confirmed as failures. 

- MEAN FLIGHT HOURS BETWEEN FAILURES - (MFHBF) The total 
flight hours divided by the total number of failures. 
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UNSCHEDULED MAINTENANCE MAN-HOURS - (UMMH) The number 
of man-hours expended in the performance of unscheduled 
maintenance as reported in VIDS/MAF records. 

MAINTENANCE MAN-HOURS PER FLIGHT HOUR - (MMH/FH) The 
total unscheduled maintenance man-hours divided by the 
total flight hour. 

MAINTENANCE MAN-HOURS PER MAINTENANCE ACTION - (MMHMA) 
The total unscheduled maintenance man-hours divided by 
the number of maintenance actions initiated . 
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Ill, HYPOTHESIS TESTING 



A . HYPOTHESIS DEVELOPMENT 

In this section we perform one-sided statistical test of 
hypothesis about the difference in the means of the main- 
tenance man-hours per flight hour (MMH/FH) for the two data 
samples, i.e. pre-SR&M and post SR&M components. One of 
the stated goals of the SR&M program will be met if the 
maintenance man-hours per flight hour (MMH/FH) is lower for 
the post SR&M aircraft than it is for the pre-SR&M aircraft. 

Before proceeding to hypothesis testing it was necessary 
to establish as acceptable distribution for MMH/FH. This was 
accomplished using standard goodness of fit tests. After 
entering numerous samples from both data bases into the 
software package GRAFSTAT, it was determined that the 
MMH/FH data could be Normalized using the In (natural 
logarithm, base e) transformation. Figure 3.1 (histogram plot) 
and Figure 3.2 (Quantile-Quantile Plot) from GRAFSTAT display 
the transformed data ln(Y) for different WUCs fitted to the 
Normal Distribution. One way to summarize a distribution is to 
partition the data into several intervals of’ equal length, 
count the number of points in each interval, and plot the 
points as bar lengths is a histogram. [Ref. 2] A perfect 
Normal distribution is superimposed on the histogram. Figure 
3.1 shows the Normal distribution to provide a good fit to the 
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data. In a Quantile-Quantile plot a perfect Normal distri- 
bution would plot as a straight line. [Ref. 2] Again the 
normal distribution is a good approximation for the 
distribution of the data. 

The Kolmogorov-Smirnof f statistic provided by GRAFSTAT 
was 0.049973 with a significance level of 0.8647. The 
Chi-Square value was 2.1776 with 6 degrees of freedom at a 
significance level of 0.90267. These results support to our 
assumption that the ln(MMH/FH) has a normal probability 
distribution . 

Once the data was transformed, standard hypothesis testing 
procedures (see Gibra) [Ref. 1] were used. The hypothesis was 
designed to look for a significant difference in mean 
MMH/FH between the modified and non-modified aircraft. 
Specifically a one sided test of hypothesis was selected 
to detect if the mean of the transformed data for modified 
aircraft is substantially smaller than the mean of the 
transformed data for non-modified aircraft. 

There are two ways the hypothesis can be set up: 



1) construct 1 



construct 2 



H 

( 

H 

( 

H 



IX - fl > 0 

X y — 



4x 

^x 

Mv 



My < 0 

My £ 0 

My > 0 



where M = mean of a natural logarithm of the maintenance 
man-hours per flight hour for modified aircraft 
(post SR&M) 

2) M = mean of the natural logarithm maintenance 

^ man-hours for non-modified aircraft (pre-SR&M) 
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RELATIVE FREQUENCY 
0.05 0.10 0.15 0.20 



NORMAL DENSITY FUNCTION, N=144 




Figure 3.1 Histogram of Natural Log of MMHFH Fitted 
to Normal Dist 
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NORMAL PROBABILITY PLOT. N = 144 




Figure 3.2 Quantile-Quantile Plot of MMHFH Fitted 
to Normal Dist 
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If the hypothesis is set up as described in construct 
2 the null hypothesis (H^ : ^ 0) would be accepted 

(and the claim of improvement "demonstrated") if: 




s a V, 

where s is the appropriate estimate of the standard 
deviation of X - Y, t^^, is the upper 100(1 - «) percentile 
point of a t-distribution with the appropriate degrees of 
freedom, v, and X and Y are the sample means of the MMH/FH 
data for pre-SR&M and post SR&M respectively for the hardware 
unit under consideration. Note that t and s are both 

av, 

positive. Consequently we could accept the null Hypothesis 

that M - fji ^0 even when X - Y is positive but smaller 
X y 

than s*t^ . Consequently little or no actual reduction in 
MMH/FH would still make it likely that we would accept the 
null Hypothesis and the claim. ^ This construct makes it easy 
to "demons t rate ” an improvement without having effected a 
substantial improvement. 

However, if we set up the Hypothesis as described in 
construct 1 with, the claim for improvement in the 
alternative Hypothesis (H^ : ” ^y much more 

difficult to show there has been an improvement. In this 
case we would reject H^ (and accept the claim for improvement) 
if : 

X - T 

< -t 

S Of V, 
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This means not only must (X - Y) be negative it must be 
smaller than the negative number s t ^ If we can say 
there is an improvement with the Hypothesis set up this way, 
there is a greater chance of there actually being an 
improvement in the maintainability Measure of Effectiveness 
(MOE) for a SR&M modified CH-46. 

The raw data was converted into CMS (Conversational 
Monitor System in use at W. R. Church Computer Center) files 
utilizing the software package GRAFSTAT. Once a CMS file 
with the data was created the data could be moved into the 
software package MINITAB, and the Hypothesis testing portion 
of the data analysis was performed. The Hypothesis used 
was : 

construct 1 H : ^0 

o X y — 

H : ^ ^0 

a X y 

The rejection rule used by MINITAB was: 

X - Y < -s-t^i u (3.1) 



u = 



( (S^/ n+S^/m) ) ^ 

[(S^/n)“/(n-l)] + [(S^/m)V(m-l)] 



S 



2 



n in 



(3.2) 



(3.3) 
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where , 



X = sample mean for post SR&M aircraft, 

Y = sample mean for pre-SR&M aircraft, 

n = number of aircraft is the post SR&M sample,, 

m = number of aircraft in the pre-SR&M sample, 

a = level of significance, 

u = degrees of freedom (see equation 3.2), 

= sample variance (see equation 3.3), 

2 

S = sample variance for post SR&M aircraft, 

X 



o 




9 

s = the square root of 



Recall that all of the above statistics are formed from the 

natural logarithm of the MMH/FH. The 100(1 - a)% upper 

confidence limit for u - u isX-Y+t 

^ X ^ y a , u 

The results from MINITAB Hypothesis testing are listed 
in Tables II and III. These tables list X - Y, upper 80% 
and 90% confidence limits and in the last column the largest 
confidence levelyfor which the upper y% confidence limit is 
zero. If the upper 100 (1 - a)% confidence limit is less 
than 0, the the Hypothesis H^ : ^ would be rejected 

in favor of H^ : <0 when testing the hypothesis at 

level a. It is usually more meaningful to the user to think 
of the Y values in the last column as the largest confidence 
he can have that " ^y ^ For example WUC 24A10 is the 
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auxiliary power plant. The data on this unit shows X - Y 

= -0.349. The upper 80% confidence limit for p - y is 

X y 

-0.03. That is we are 80% confident that u - P ^ -0.03. 

X y 

Similarly we are 90% confident that p^ - p^ < 0.14. Also 
we are 82% confident that ^ ~ y ^ interesting 

to note that there are 8 items of the 21 listed for which we 
are less than 50% confident that any improvement in mean 
maintenance manhours per flight huor (MMH/FH) has been 

reduced due to the SR&M program using this data. The only 

difference between the two tables is Table II is by individual 
WUCand Table III is by major maintenance category. 
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wuc 

11310 

11560 

11610 

11620 

13110 

13210 

14130 

14170 

142A0 

14210 

14230 

14270 

142S0 

15A10 

24A10 

26110 

26240 

26610 

26S10 

29D90 

44114 



TABLE II 



RESULTS OF 


HYPOTHESIS TESTING BY 


WUC 




UPPER CONF LIMIT 
ON 


LARGEST 
CONF LEVEL 




I‘x * I^y 




I‘x - I^y < 0 


X - Y 


80 % 


90 % 


Y 


0.37 


0.81 


1.05 


0.24 


1 

oo 


-1.00 


-0.795 


1.0 


-0.54 


-0.12 


0.10 


0.86 


-1.31 


-0.92 


-0.695 


0.99 


-0.09 


0.32 


0.50 


0.52 


0.00 


0.36 


0.56 


0.5 1 


-1.28 


-0.84 


-0.68 


1.0 


0.24 


0.74 


1.02 


0.35 


-0.45 


-0.01 


0.24 


0.80 


-0.01 


0.44 


0.68 


0.50 


-0.04 


1.39 


3.16 


0.51 


0.31 


1.06 


1.53 


0.36 


0.62 


1.10 


1.30 


0.063 


-0.48 


-0.26 


-0.15 


0.97 


-0.34 


-0.03 


0.14 


0.82 


0.17 


0.74 


1.06 


0.40 


0.41 


0.09 


0.36 


0.76 


-0.55 


0.98 


1.21 


0.025 


1.31 


2.35 


3.00 


0.15 


1.09 


1.44 


1.63 


0.0067 


-1.13 


-0.69 


-0.43 


0.97 
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TABLE III 



RESULTS OF HYPOTHESIS TESTING BY 
MAJOR MAINTENANCE CATEGORIES 

UPPER CONF LIMIT LARGEST 

ON CONF LEVEL % 







•»x 


-Hy 


- f* 


wuc 


X - Y 


SO % 


90 


7 


1 1000 


.007 


0.54 


0.65 


6.51 


12000 


0.25 


0.45 


0.55 


0.14 


13000 


-0.41 


-0.20 


-0.09 


0.84 


14000 


-0.32 


-0.13 


-0.03 


0.92 


15000 


-0.5 1 


-0.30 


-0.18 


0.97 


26000 


-0.02 


0.44 


0.69 


0.03 


42000 


0.33 


0.54 


0.o5 


0.17 
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IV. REGRESSION ANALYSIS 



A. PROCEDURES 

A regression analysis was performed to determine if the 
MFHBF was decreasing as a function of the previous number 
of failures. The paired data MFHBF and number of failures 
was entered into an APL (a mathematical programming language) 
workspace by work unit code (WUC). An APL program was 
developed to compute the mean flight hours for all aircraft 
by the number of failures. The results were then brought 
into a workspace in the statistical package GRAFSTAT. The 
paired data was plotted with the mean flight hours between 
failures (MFHBF) on the y-axis and the number of failures 
on the x-axis. The data for WUC 24A10 the Auxiliary Power 
Plant (APP) will be used and displayed in Figure 4.1 
(pre-SR&M) and Figure 4.2 (post SR&M) . The data for Major 
Maintenance Category 13000 the Landing Gear will be used and 
displayed in Figure 4.3 (pre-SR&M) and Figure 4.4 (post SR&M) . 

The Least Squares Estimates of the slope (b) and the 
intercept (a) were then computed by GRAFSTAT. 

k 2 ■ 

The Sum of Squares ^ d. is defined as: 

i=i ^ 
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MFHBF 



024A10 




Figure 4.1 PRE-SR&M WUC 24A10 
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K\F\-\BF 



N24A1Q 




Figure 4.2 POST-SR&M WUC 24A10 
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MFHBF 



X01300Q 




Figure 4 . 3 



PRE-SR&M WUC 13000 



MFHBF 



XN13000 




Figure 4.4 POST-SR&M WUC 13000 
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(4.1) 



2 d? = ^ [ y . -( a+bx . ) ] ^ . 

i = l ^ i = l ^ ^ 

When the left-hand side is minimized the values of a (inter- 
cept) and b (slope) describe the line y = ax + b that best 
fits the data using the method known as least squares 
regression. This was done to estimate the time until first 
failure (intercept) and the rate of decline in MFHBF (slope) 
per failure by work unit code for numerous WUC. 

Table IV displays the computed values for the slope and 
intercept associated with the regression of MFHBF on number 
of failures for selected WUC units. They were computed by 
GRAFSTAT. Table V displays the same information for major 
maintenance categories. For example 13000 is the data for all 
WUC starting with the numbers 13 , the CH-46 airframe. 

There are numbers in the table that are unrealistic, 
some WUC have increasing slopes, i.e., the part is less likely 
to require maintenance the more the aircraft is flown. These 
points are included to emphasize the problems with the data 
base, it is not perfect but the problems should be the same 
for both samples. 

The data in Tables IV and V shows that the aircraft is 
likely to fly more hours before the new components experience 
their first failure. The numbers for WUC 24A10 non-modified 
aircraft are intercept 100.69 and slope -10.567, and intercept 
154.56 and slope -17.508 for modified aircraft. The numbers 
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TABLE IV 



LEAST SQUARES REGRESSION FIT BY WUC 



INTERCEPT SLOPE 



WUC 


OLD 


NEW 


%CHANGE 


OLD 


NEW 


11220 


169 


251 


148 


-55.8 


-50.2 


11310 


158 


257 


162 


-34.4 


-54.33 


llooO 


102 


124 


180 


-10.3 


- 8.76 


11560 


123 


222 


180 


-15.0 


-36.5 


11610 


84 


243 


290 


- 6.1 


-34.2 


11620 


- 


- 


- 


- 


- 


12510 


- 


- 


- 


- 


- 


13110 


138 


222 


116 


- 5.7 


-61.2 


13210 


167 


194 


116 


-40.5 


54.8 


14130 


56 


211 


377 


- 2.7 


-35.9 


142.\0 


166 


178 


107 


-36.3 


-14.3 


14210 


138 


223 


163 


-27.0 


26.8 


14230 


168 


257 


153 


-49.8 


- 


14260 


147 


202 


137 


-19.1 


-32.8 


14270 


154 


296 


192 


63.8 


-68 


142S0 


167 


204 


122 


-33.6 


-35.9 


24A 10 


101 


154 


151 


-10.6 


-17.5. 


26110 


- 


- 


- 


- 


- 


26120 


178 


241 


136 


-29.9 


-60.2 


26240 


150 


244 


163 


-17.5 


-6 1.5 


26460 


142 


246 


174 


-46.8 


-13.0 


26510 


132 


190 


143 


-17.8 


-34.6 


26610 


133 


168 


127 


-20.8 


-21.8 


44114 


86 


226 


262 


- 8.3 


45.5 



- not enough data for one of the samples to conduct LSR comparison. 
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for WUCs starting with 13 (Table V) non-modif ied aircraft 

are intercept 100.11 and slope -11.842, modified intercept 
132.31 and slope -13.335. Hypothetically the modified air- 
craft can log approximately 54 more flight hours, on average 
before requiring maintenance on its APP. This is an improve- 
ment of 153% for the APP. In the case of WUC starting with 

13 the improvement was 132%. This fact alone should 

reduce the cost of operating the aircraft in the Fleet 
Marine Force. 



TABLE V 

LEAST SQUARES REGRESSION FIT BY MAJOR 
MAINTENANCE CATEGORIES 





INTERCEPT 




SLOPE 




WUC 


OLD 


NEW 


% CHANGE 


OLD 


NEW 


11000 


11 


20 


182 


-0.15 


-0.36 


12000 


39 


56 


144 


- 2.1 


- 2.7 


13000 


100 


132 


132 


-11.8 


-13.3 


14000 


56 


71 


127 


- 4.2 


- 4.4 


15000 


11 


22 


200 


- 0.2 


- 0.4 


26000 


S4 


o6 


79 


-6.4 


-3.7 


42000 


40 


■o 


55 


- 1.9 


- 0.5 



The improvements in mean time until first failure range 
from a low of 107% to a high of 377%. It is interesting to 
point out in numerous cases tne mean time until first failure 
was greatly improved while the slope was also a decreasing 
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negative number so after 4 or 5 failures the MFHBF was 
essentially equal for both modified and non-raodified aircraft. 

• When the data was looked at grouped by major maintenance 
categories : 

11000 Airframe 

12000 Fuselage Compartment 

13000 Landing Gear System 

- 14000 Flight Controls 

- 15000 Rotor System 
26000 Drive system 

42000 Electrical Power Supply 

The improvements varied from a low of 55% to a high of 200%, 
in the mean time until first predicted failure. 

The WUC analyzed were selected because they were directly 
impacted by one of the SR&M modifications. Mr. William 
Jennings, the Boeing-Vertol Technical Representative at 
Marine Corps Air Station (H) New River, North Carolina, was 
very helpful with this selection of WUC. 

B. DECREASING TREND AND- VARIANCE ANALYSIS 

The data in Table IV and the regression charts, suggest 
that MFHBF is decreasing as the number of failures increases, 
i.e., items with 6 failures have lower flight hours between 
failures than aircraft with 1 or 2 failures? If this is 
actually the case it would be important to know the rate of 
decrease more accurately than can be determined from this 
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data base. It is necessary to have the actual flight times 
betweeen each failure in order to make this assessment. 

If MFHBF does decrease as number of failures accumulate, 
then the affect of the SR&M program washes out after some 
number of failures. It is also important to know this in 
order to more accurately estimate the reliability of each 
aircraft, i.e., the failure history of its components affect 
its reliability, Here it would be good to have the actual 
flight time between each failure. We have no information 
to confirm or deny that each failure was a separate and 
distinct problem. 

It is also of interest to know if the variance of MFHBF 

changed as a function of the number of accumulated failures. 

2 

That is, is s for an item with 4 failures the same as for 
an item with 6 failures? To answer this question three 
items were examined. 

In Table VI the number of failures is listed in the far 
left-hand column, the 3 selected WUC across the top and the 
associated variance for that number of failures is listed 
where appropriate. If there was no aircraft with the number 
of failures for that WUC the table was left blank. There is 
a wide range in the variance for all the components looked at. 
Just by looking at these three components we are confident is 
saying the variance is not equal among groups with different 
number of failures. 
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TABLE VI 



VARIANCE OF FAILURE RATE 



FAILURES 13110 





OLD 


NEW 


0 


1292.7 


2142.7 


1 


2908.9 


0.0 


2 


780.0 


242.0 



4 

5 

6 
7 
S 
9 



24A10 44114 



OLD 


NEW 


OLD 


3894.3 


0.0 


0.0 


722.0 


4280.3 


1022.7 


0.0 


0.0 




125.0 


89.8 


214.2 


12.5 


359.1 


1.3 


0.0 


0.0 




257.6 


0.0 




0.0 


0.0 


84.6 






0.0 



NEW 

1885.1 

3042.0 
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V. ADDITIONAL ANALYSIS 



A. REGRESSION ANALYSIS OF MTBF (MEAN TIME BETWEEN FAILURES) 

The analysis in Chapter IV indicated that mean flight hour 
per failure decreased as the number of failures (hence repairs) 
accrued against hardware. If this relationship is correct it 
has important implications for scheduling of maintenance — 
both in flight hours between repairs and in planning resource 
requirements. The 3M data used to make the analysis in 
Chapter IV does not provide sufficient detail to make an 
accurate analysis of the linear relationship between mean 
flight hour between failure and number of accured failures. 

The data needed to provide an accurate analysis is the 
actual flight hours between each failure for each type of 
component (by WUC or serial number) for which such analysis 
is desired. In particular if such an analysis is desired 
to be developed and maintained for the Auxiliary Power Plant 
(APP) units, then the actual flight hours between each failure 
of each APP unit must be kept by APP serial number. 

Thisdata would not only afford trend lines but would 
also permit the prediction of percentile points for the 
distribution of flight time to failure for APP units which 
have had previous failures (and repairs). That is, this type 
of data will allow us to make an estimate of number of flight 
hours, t(a,i), for which 
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P[T^ < t (a ^i) ] = a 

where denotes the flight hours to failure of an APP unit 
which has had i previous failures. For example, if - 
a = 0.90, APP units with 5 previous failures will fail ag.ain 
before t(o^,i) with probability 0.90. 

B. GENERAL ANALYSIS 

The following analysis can be applied to any type of 
assembly i.e., x^PP , Flight Controls, etc. But the type of 
assembly is fixed in any specific application. The data 
always refers to flight hours to failure for the same type of 
assembly . 

The model we use makes assumptions about the probabilty 
dis tribu t ion . Specifically we assume the normal distribution. 
This assumption can be checked by appropriate analysis provided 
time between failure data is available, but whatever the 
appropriate probability distribution is determined to be, a 
similar analysis can be developed. Most of the analysis, i.e.-, 
the regression point estimates will still be valid regardless 
of the underlying distribution. The confidence bounds, 
however, would change. Also, if enough data is available 
so that five or more flight hour data points are available 
for each of the number of failure points (i.e., i = 0,. 1,2,..*F) 
then the normality assumption might still be valid because we 
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will be using sample averages and the Central Limit Theorem 

will apply to yield and approximate Normal distribution. 

Let t. . denote the flight time to failure for all 

ij 

components of the type under consideration which had i 

previous failures, i = 0,1,2, J=l,2,...,n^ 

n , 

1 ^ 

Let T. = — St.. 

1 n . . 1 X j 

1 J = 1 



- F . F 

Let T= Z S T../(S n.) 

i=0 j=l i=0 ^ 



F 

Let f = ( S i)/F. 
i = 0 



We used, the standard regression model, T. . = 1 + bi + e. . . 

ij ij 

2 

Where e. . is a random variable with mean 0 and variance a 
ij 

for all ij . Then 

E(T . . ) = a + bi . 
ij 

Then at each failure, i = 0,1,2, ...,F we have several 
observations as indicated in Figure 5.1. 

We fit a regression line to this set of data using 
standard least squares methods. The least squares estimates 
a and b for a and b respectively are: 
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a 



T 



bf 



b = (I(T. - T)i)/( 2 (i-f)2) 

^ i = 0 

Thus the data points (T^. ,0), (T., 

U , i (J , n i , 1 

(T. T T&F , n F ) yield the fitted line 

1 , z i , i 

T = a bi in Figure 5.1. 

To obtain the t(a,i) values we need the probability 

distribution for T.. We shall assume it is normal with 

1 

^ t h- 

mean a bi and variance . Then the ^ percentile point 

t(a,i) is a + bi -r aZ^ where is the percentile point 

2 

of the standardized normal distribution (u = 0, a = 1). 

The estimate of t(o^^) is 



t(a , i) = a + bi + s(Z^ ) 



9 2 

where s" is the unbiased estimate of o 

F ni _ - 

2 S (t . . - T. 

2 1 = 0 ■'=1 

s = 



S (n.-l) 



C. INFERENCES ON SYSTEM RELIABILITY 

The appropriate equation for helicopter system reliability 

R is a function of the assembly reliabilities; i.e., 
s 

Rg = 8 (Rj^».*.iRi^) where R^ = reliability of assembly i. In 
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FLIGHT HOURS PER FAILURE 



CONTROL CHART 




NUMBER OF FAILURES 



Figure 5.1 Control Chart 



particular if the assemblies are chosen at high enough level 
and if failure times are statistically independent , 

K 

R = 1 R. 

s i=l ^ 

The appropriate reliability block diagram will depend on the 

level of indenture of the assemblies* This in turn \^/ill 

determine the appropriate function g ( , . . . , ) . 

At a point in time any aircraft will- be composed of 

assemblies with different failure and repair records. The 

point estimates of mission reliability of assembly k will 

be a function of a, + b^ i(k) where i(k) is the number of 

previous failures on assembly k of that particular helicopter. 

2 2 

The estimate s . for c: , and the assembly mission time 

corresponding to system (helicopter) time t will yield 
a point estimate Rj^(tj^) of the mission reliability of 

the k component. These point estimates of the assembly 
mission reliability corresponding to system mission time t 
will give a point estimate of system reliability; namely, 

Rg(t) = g(R^ ( ) , R^C t2> , . . . . ) . 

The preliminary analysis on Mean flight hours between 
failures provided in Chapter IV, indicate a strong decline 
as the number of failures increase. This will certainly 
have to level off at some point for the helicopter's 
lifetime even with repairs is certainly limited. These 
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preliminary results suggest that keeping the additional 
data needed to perform the analysis cited in this section 
could well be worth the effort. 
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VI. CONCLUSIONS AND RECOMMENDATIONS 



A, CONCLUSIONS 

The data in Table IV indicate the items for which we are 
confident that there is an improvement in the reliability of 
the C-46 SR&M modified aircraft. At present there is not 
enough operatonal data available to verify the extent of 
this improvement. Is the improvement due to operating with 
new components? Will the reduction in MFHBF for the modified 
aircraft result in more maintenance than presently indicated 
in the long run? These questions can only be answered with 
additional data analysis in the future when more complete 
data becomes available. 

Of the Twenty-one WUCs considered, we can say nine of them 
showed a reduction in the MMH/FH. Five show an increase in 
the MMH/FH. The other seven show no significant change. This 
leads us to conclude the SR&M modified aircraft has some 
improved maintainability. We may also see greater 
improvements when mechanics become more familiar with the 
new systems /components. 

B. RECOMMENDATIONS 

Initiate a data collection program to collect flight hours 
between failure and flight hours between maintenance action 
peformed on each aircraft. Perform additional analysis 
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after the aircraft has been in the Fleet Marine Force and has 
accumulated more operational flight hours. 
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